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ABSTRACT 

The  JINTACCS  program  was  established  to  insure  the 
interoperability  of  tactical  command  and  control  systems 
used  in  joint  military  operations.   One  of  the  standards 
JINTACCS  has  developed  is  a  message  format  to  enhance  the 
exchange  of  written  information  within  the  joint  task  force. 
This  research  investigated  the  susceptibility  of  the 
JINTACCS  message  formats  used  in  air  operations  to  jamming. 
The  susceptibility  was  measured  by  comparing  the  percent  of 
under standability  of  JINTACCS  messages  to  all  plain  text 
non-formatted  messages  after  each  had  been  subjected  to 
equal  levels  of  electronic  jamming.   Continuous  and  burst 
jamming  were  modeled  for  this  experiment.   The  experimental 
results  revealed  no  statistically  significant  differences  in 
the  percent  of  understandability  between  the  JINTACCS  messages 
and  the  plain  text  messages.   Curves  of  understandability 
were  established  from  the  experimental  results  for  different 
levels  of  continuous  jamming  and  different  levels  of  burst 
jamming. 
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I.   BACKGROUND  LEADING  TO  EXPERIMENT 

A.   INTRODUCTION 

The  Joint  Interoperability  of  Tactical  Command  and 
Control  Systems  (JINTACCS)  program  was  established  by  the 
Department  of  Defense  in  1971.   It  is  a  joint  service  inter- 
face program  designed  to  develop  standards  and  procedures  to 
insure  the  interoperability  and  operational  effectiveness  of 
those  tactical  command  and  control  systems  used  in  support 
of  joint  and  combined  ground  and  amphibious  military  opera- 
tions.  One  of  the  standards  JINTACCS  has  developed  is  a 
message  format  to  enhance  the  exchange  of  information  within 
the  joint  task  force.   The  purpose  of  this  thesis  is  to 
evaluate  the  susceptibility  of  the  JINTACCS  message  format 
to  two  different  types  of  electronic  jamming.   The  evaluation 
consists  of  an  experiment  where  JINTACCS  formatted  messages 
are  compared  to  plain  text  non-formatted  messages  given  an 
equal  amount  of  jamming  for  each  message. 

The  reasons  behind  this  thesis  are  as  follows.   In  the 
tactical  battlefield  environment  our  message  communications 
are  subject  to  two  specific  types  of  electronic  jamming: 
continuous  and  burst.   With  the  new  JINTACCS  message  formats, 
it  is  important  to  consider  the  effects  of  jamming  on  the 
understandability  of  these  messages  before  the  services 
implement  the  system.   Experiments  such  as  those  performed 
in  this  research  effort  can  hopefully  reveal  that,  at  the 
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very  least,  the  U.S.  services  are  no  worse  off  using  the 
JINTACCS  format  with  respect  to  jamming  susceptibility. 
Also  these  types  of  experiments  may  point  out  weak  areas 
where  the  effectiveness  or  understandability  of  the  JINTACCS 
message  format  can  be  improved.   In  the  joint  tactical  envi- 
ronment, the  communication  of  critical  information  between 
force  elements  directly  affects  the  success  or  failure  of 
the  mission.   It  is  hoped  that  research  such  as  this  will 
contribute  to  success  in  the  joint  arena. 

B .   JINTACCS 

1.   Purpose 

The  JINTACCS  program  was  established  by  the  Depart- 
ment of  Defense  with  the  overall  goal  of  achieving  inter- 
operability of  tactical  command  and  control  systems  in  joint 
and  combined  operations.   Interoperability  is  defined  here 
as  the  capability  of  one  service  to  operate  with  one  or  more 
of  the  other  services  in  order  to  increase  efficiency, 
mission  effectiveness,  or  combat  power.   The  key  to  inter- 
operability is  compatibility  because  it  is  only  when  all 
service  forces  can  exchange  information  in  near  real  time 
under  extreme  combat  conditions  that  interoperability  is 
achieved  [Ref.  1] .   One  part  of  the  JINTACCS  program  is  to 
develop  standard  message  formats  that  can  be  used  and 
understood  by  all  services  in  a  joint  arena. 
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2 .   Overview 

The  JINTACCS  program  is  a  continuation  and  consoli- 
dation of  previous  DOD  efforts  to  achieve  interoperability 
of  tactical  command  and  control  systems  in  joint  operations. 
The  need  for  the  program  was  driven  by  the  proliferation  of 
sophisticated  weaponry  and  computers  on  today's  battlefield. 
Traditionally,  combat  tasks  have  been  relatively  straight- 
forward with  manual  procedures  using  people  as  the  medium  to 
achieve  interoperability.   In  the  1960's  the  use  of  automa- 
tion for  tactical  systems'  tasks  increased  greatly.   Today, 
all  services  are  actively  pursuing  automation  across  the 
tactical  equipment  spectrum,  resulting  in  the  fact  that  we 
can  no  longer  rely  on  manual  procedures  nor  people  to 
provide  interoperability  [Ref.  2]. 

Several  lessons  were  learned  from  our  tactical 
operations  in  Southeast  Asia,  the  WESTPACNORTH  interface 
program  and  the  Tactical  Air  Control  Systems/Tactical  Air 
Defense  Systems  (TACS/TADS)  interface  program.   Two  lessons 
were  the  recognition  that  after-the-fact  system  integration 
is  both  costly  and  time  consuming.   Another  lesson  was  that 
joint  interoperability  is  especially  difficult  after  a 
service's  automated  systems  are  put  into  operation.   Also, 
we  learned  that  standardization  among  the  services  can  solve 
some  of  the  problems,  but  joint  service  support  is  essential 
for  standardization  to  be  achieved  [Ref.  3].   From  this 
experience  and  these  lessons,  the  JINTACCS  program  was 
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established  by  the  Joint  Chiefs  of  Staff  (JCS)  in  1971 
[Ref.  4]. 

The  mission  of  the  JINTACCS  program  is  "to  insure 
that  in-service  and  joint  plans  are  developed  to  achieve 
technical  compatibility  and  that  tests  and  demonstrations 
are  conducted  to  exhibit  the  compatibility,  interoperability 
and  operational  effectiveness  of  those  tactical  command  and 
control  systems  used  in  support  of  ground  and  amphibious 
military  operations"  [Ref.  5]. 

The  JINTACCS  program  methodology  is  a  four  step 
process.   The  first  step  was  the  development  of  the  program 
architecture,  including  the  information  to  be  exchanged 
between  tactical  operational  facilities.   The  next  step  was 
the  development  of  an  engineering  implementation  plan  that 
specifies  the  technical  standards  required  to  achieve  com- 
patibility and  interoperability  as  specified  in  the  program 
architecture.   This  includes  the  message  standards  and 
implementation  methods  that  should  be  used.   Because  of  its 
size,  the  JINTACCS  effort  was  divided  into  five  separate 
functional  segments:   intelligence,  fire  support,  amphibious 
operations,  operations  control,  and  air  operations.   A 
JINTACCS  computer  library  was  established  where  all  message 
elements  are  categorized.   The  third  step  of  the  program  is 
to  develop  the  test  documents,  conduct  compatibility  and 
interoperability  testing,  demonstrate  operational  effective- 
ness, and  document  the  results.   The  fourth  and  final  step 
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of  the  JINTACCS  program  will  be  the  publication  of  approved 
documents  and  standard  data  elements  and  sets  [Ref.  6]. 
The  standards  and  procedures  established  by  the 
JINTACCS  program  are  designed  to  provide  a  more  effective 
exchange  of  information  within  the  joint  task  force.   The 
JINTACCS  message  formats  were  developed  by  operational 
experts,  joint  committees  and  engineers  to  satisfy  the 
following  standards  and  procedures  [Ref.  7]: 

a)  Message  standards  must  be  man  and  machine 
readable 

b)  A  Message  Element  Dictionary  must  be  used  to 
insure  information  is  understood  by  all  players 

c)  Interface  operating  procedures  will  insure  the 
right  messages  go  to  the  right  people  at  the 
right  time  over  the  right  communications 

d)  Data  standards  will  insure  machines  and 
communications  work  together. 

As  the  new  language  of  battle,  JINTACCS  messages 
must  be  understood  by  all  players  in  the  joint  task  force 
environment.   Any  ambiguities  in  the  meanings  of  words, 
phrases,  or  terms  between  services  must  be  eliminated  to 
effectively  coordinate  the  use  of  people,  weapons,  and 
resources.   The  JINTACCS  standards  and  procedures  are 
designed  to  meet  these  goals. 


15 


C.   JAMPS 

1.  Purpose 

The  JINTACCS  Automated  Message  Preparation  System 
(JAMPS).  is  designed  to  implement  the  JINTACCS  joint  message 
standard  after  1985.   It  is  an  automated  system  that  will 
facilitate  JINTACCS  message  preparation  by  operations  per- 
sonnel and  that  will  provide  for  a  graceful  transition  to 
JINTACCS.   The  JINTACCS  Technical  Interface  Design  Plans, 
Message  Element  Dictionary/  and  Catalog  of  Keyword  Data 
Sets  contain  over  5,000  pages  of  JINTACCS  message  preparation 
guidance.   JAMPS  utilizes  computer  terminals  for  message 
preparation  that  make  those  5,000  pages  of  guidance  trans- 
parent to  the  operator.   JAMPS  provides  menu  selection  for 
message  preparation,  automatically  formats  message  fields, 
provides  editing  capability,  generates  standard  message 
headers  and  trailers,  and  sends  and  receives  the  prepared 
messages.   In  short,  JAMPS  will  provide  tactical  commanders 
and  operators  with  an  automated  capability  to  deal  with 
JINTACCS  message  standards  in  a  joint  tactical  environment 
[Ref.  8]. 

2 .  Overview 

The  basis  for  Air  Force  support  of  the  JINTACCS 
program  was  established  by  Program  Management  Directive 
(PMD)  R-S-9057(1)/64779F,  12  April  1979.   The  PMD  directed 
Tactical  Air  Command  (TAC)  to  serve  as  the  lead  command  for 
JINTACCS  Operational  Effectiveness  Demonstration  (OED) 
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planning  and  execution  and  to  give  due  consideration  to 
automated  systems  [Ref.  9]. 

An  Intelligence  OED  performed  in  19  81  demonstrated 
the  difficulty  in  preparing  JINTACCS  messages  manually.   If 
the  messages  are  difficult  to  prepare  manually,  that  is,  if 
no  automated  assistance  is  available,  it  was  believed  that 
operators  would  view  the  JINTACCS  standard  as  unacceptable 
[Ref.  10].   In  addition,  the  JINTACCS  messages  are  designed 
to  be  machine  processable  as  well  as  human-readable.   Without 
automating  JINTACCS ,  the  standard  for  them  to  be  machine 
processable  cannot  be  tested  [Ref.  11] .   For  these  reasons, 
the  JAMPS  requirement  was  identified. 

The  JAMPS  software  was  designed  to  provide  many 
capabilities  while  remaining  flexible  for  possible  future 
requirements  or  changes.   It  was  built  on  a  modular  concept 
and  uses  tables  external  to  the  program  code  to  store  infor- 
mation on  the  JINTACCS  standard.   This  allows  changes  to  the 
JINTACCS  standards  to  be  made  quickly  as  no  reprogramming  is 
required.   The  JAMPS  software  is  designed  to  [Ref.  12]: 

a)  Prompt  operations  personnel  during  message 
preparation 

b)  Format  message  fields  and  segments  in 
conformance  with  JINTACCS  rules 

c)  Provide  message  editing  capabilities 

d)  Generate  the  standard  message  header  and 
trailer  information 
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e)  Maintain  message  history  files  that  sequentially 
store  all  incoming  and  outgoing  messages 

f)  Display  and  provide  record  copies  of  incoming 
and  outgoing  messages  as  required. 

Because  of  the  above,  the  JAMPS  software  should  be 
"user  friendly"  and  should  insure  that  operators  generate 
accurate  JINTACCS  messages.   This  should,  in  turn,  enhance 
the  exchange  of  critical  information  on  the  tactical  battle- 
field and  therefore  improve  interoperability. 

In  addition,  the  JAMPS  software  was  designed  to 
accommodate  a  wide  range  of  operator  expertise.   The  software 
appears  totally  menu  driven  to  the  novice  operator  and  allows 
the  operator  to  choose  from  sets  of  alternatives.   Detailed 
descriptions  are  provided  at  each  point  to  "step"  the  opera- 
tor through  the  process.   On  the  other  hand,  an  experienced 
JAMPS  operator  can  bypass  the  cumbersome  hand-holding  modes 
and  complete  a  message  directly  and  quickly.   The  experienced 
operator  can  still  obtain  help,  if  required,  at  any  point. 
Finally,  the  JAMPS  software  includes  a  developmental  toolkit 
with  a  thorough  and  repeatable  test  of  the  software,  an 
"instant  replay"  of  any  JAMPS  session  to  help  identify  and 
correct  any  unanticipated  problems ,  and  a  means  for  obtaining 
message  preparation  statistics  [Ref.  13]. 

The  hardware  for  JAMPS  is  also  of  modular  design. 
The  Phase  I  version  of  JAMPS  that  is  now  in  use  at  Head- 
quarters TAC  relies  on  a  single  central  processing  unit  (CPU) , 


a  PDP-11/70,  connected  to  a  number  of  "dumb"  terminals, 
Perkin-Elmer  OWL  1200 's.   This  configuration  is  what  was 
used  for  the  experiment  conducted  in  this  research.   Phase 
II  requirements  for  JAMPS  are  being  worked  at  this  time  to 
provide  the  hardware  for  post-19  85  JINTACCS  command  and 
control  communications  requirements  [Ref.  14]. 

Overall,  the  present  JAMPS  provides  an  automated 
message  preparation/communication  capability  that  is  "user 
friendly"  and  that  makes  the  JINTACCS  message  standards 
transparent  to  the  operators.   The  design  of  the  system 
allows  quick  changes  or  modifications  to  the  message  formats 
without  changing  the  program  code.   The  Phase  I  system  that 
is  presently  installed  at  Headquarters  TAC  is  a  strong  first 
step  towards  automating  command  control  communications  in  a 
tactical  environment.   It  served  as  a  good  testbed  for  this 
experiment. 

D.   ELECTRONIC  JAMMING 

Electronic  jamming  of  a  data  communications  link  can  take 
many  forms.   The  two  jamming  forms  examined  in  this  experi- 
ment are  continuous  and  burst  jamming.   A  brief  description 
of  each  is  given  below  with  an  explanation  of  the  way  each 
was  modeled. 

In  continuous  jamming  a  constant  level  signal  is  trans- 
mitted continuously  at  the  same  frequency  at  which  the 
jammed  link  or  net  is  operating.   To  be  most  effective,  the 
type  of  signal  modulation  should  be  the  same  as  the  signal 
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being  jammed,  although  this  is  not  necessary  to  interfere 
with  the  signal.   If  the  modulation  of  the  jamming  signal  is 
different  from  the  jammed  signal,  then  the  jamming  signal 
acts  as  additional  noise.   If  the  type  of  signal  modulation 
is  known  in  advance,  the  jammer  can  be  much  more  efficient 
with  the  same  power  level  by  matching  this  signal  modulation. 
Consider  a  simplified  ground-to-ground  communications  link 
as  shown  in  Figure  1. 

Let 

SI  =  Transmitted  Carrier  Power  Signal 

S   =  Received  Carrier  Power  Signal 

Jl  =  Transmitted  Jammer  Power  Signal 

J   =  Received  Jammer  Power  Signal 

From  Figure  1,  the  ratio,  J/S ,  at  the  receiver  determines 
the  effectiveness  of  the  jammer  and  whether  or  not  it  is 
successful  in  preventing  recovery  of  the  information  signal 
at  the  receiver.   The  received  power  of  the  jammer,  J,  and 
the  received  power  of  the  transmitter,  S,  are  each  determined 
by  the  original  transmission  power,  Jl  and  Si,  respectively, 
the  distance  of  each  to  the  receiver,  and  the  gain  of  the 
antennas  in  use. 

The  numerical  result  of  the  jamming-to-signal  ratio, 
J/S,  determines  the  amount  of  the  information  signal  that  is 
received  correctly  and  the  amount  that  is  garbled.   It  is 
assumed  that  the  garbling  occurs  on  a  random  basis  depending 
on  this  ratio.   When  the  ratio  is  known,  it  can  be  equated 
to  a  probability  of  jamming  on  a  bit  by  bit  basis.   In  other 
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words,  a  specified  J/S  ratio  at  a  receiver  can  be  transformed 
into  a  probability  that  each  information  bit  is  received 
correctly  or  incorrectly  and  hence  a  probability  that  any 
information  bit  is  garbled  or  jammed. 

This  probability  of  jamming  (.P  (J)  )  is  the  basis  for  the 
continuous  jamming  portion  of  the  computer  model  used  in 
this  experiment.   The  computer  model  reads  a  message  file, 
translates  each  character  into  an  eight  bit  code  used  in  data 
transmission,  and  then  garbles  the  bits  serially  based  on  a 
P(J).  specified  by  the  user.   If  the  bit  is  garbled,  it  is 
switched  from  a  1  to  a  0  or  a  0  to  a  1 ,  otherwise  the  bit 
is  left  in  its  original  state.   Since  the  parameters  affect- 
ing the  J/S  ratio  at  the  receiver  can  vary  so  greatly,  the 
probability  of  jamming  was  selected  as  the  primary  input  for 
the  computer  model.   Also  it  was  thought  that  this  would  be 
much  more  useful  and  more  applicable  for  follow-on  applica- 
tions . 

The  second  type  of  jamming  considered  in  this  research, 
burst  jamming,  transmits  a  jamming  signal  in  bursts  instead 
of  continuously.   The  jamming  signal  is  transmitted  for  a 
time  interval  followed  by  an  interval  of  no  jamming.   Like 
continuous  jamming,  it  is  most  efficient  when  the  jamming 
signal's  modulation  matches  the  jammed  signal's  modulation. 
Burst  jamming  allows  the  user  to  jam  two  or  more  signals 
with  the  same  equipment  by  splitting  his  jamming  time 
between  each  signal.   It  can,  however,  be  used  to  jam  a 
single  signal. 
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The  parameters  of  burst  jamming  are  the  same  as  con- 
tinuous jamming  when  the  burst  is  "on".   There  is  no  effect 
on  the  jammed  signal  when  the  burst  is  "off".   Therefore, 
when  the  burst  jammer  is  "on",  its  effect  on  the  received 
signal  can  also  be  transformed  directly  into  a  probability 
of  jamming,  or  P(J) ,  and  its  effect  on  a  serial  bit  stream 
can  be  calculated  in  the  same  manner  as  with  the  continuous 
mode . 

The  probability  of  jamming  along  with  the  time  between 
each  burst  and  the  time  duration  of  the  burst  are  parameters 
used  in  the  computer  model  to  simulate  burst  jamming.   The 
time  between  bursts  and  the  time  duration  of  the  bursts  are 
each  expressed  in  units  of  information  bits  rather  than  in 
units  of  time.   Again,  due  to  the  great  differences  in  data 
transmission  rates  for  equipment  in  the  field,  i.e.  from  say 
150  bits  per  second  to  96QQ  bits  per  second,  and  burst 
jamming  equipment  parameters,  it  was  felt  that  a  computer 
model  that  used  the  number  of  bits  between  each  burst  and 
the  number  of  bits  in  each  burst  would  be  more  useful  for 
varied  future  applications.   Therefore,  given  a  rate  of 
transmission,  the  burst  length  in  units  of  time,  and  the 
time  between  bursts,  an  algebraic  transformation  can  be 
made  to  a  burst  length  in  bits  and  time  between  bursts  in 
bits.   These  parameters  can  then  be  entered  into  the 
computer  program,  along  with  a  probability  of  jamming 
during  the  burst,  to  simulate  the  effect  of  a  burst  jammer 
on  any  given  message. 
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E.   COMPUTER  MODEL  TO  SIMULATE  JAMMING 

1 .  Background 

The  computer  model  simulates  jamming  a  message  based 
on  the  probability  that  an  information  bit  will  be  garbled. 
As  stated  in  the  previous  section,  the  transformation  from 
a  jamming-to-signal  ratio  to  a  probability  of  jamming  can  be 
made  when  one  assumes  that  jamming  occurs  in  a  random  fashion 
given  a  certain  ratio  level.   Since  information  bits  are 
transmitted  serially  over  a  data  communications  channel,  the 
bits  will  be  received  serially  either  garbled  or  in  their 
original  state.   The  degree  to  which  the  received  signal 
matches  the  transmitted  signal  depends  upon  the  level  of 
jamming.   The  higher  the  level  of  jamming,  the  greater  the 
number  of  information  bits  that  are  garbled.   A  computer 
program  that  reads  a  message  at  the  information  bit  level  in 
a  serial  manner  was  deemed  the  optimum  method  to  produce  a 
"jammed"  message.   These  "jammed"  messages  in  the  JINTACCS 
format  and  an  all  plain  text  with  no  format  could  then  be 
used  to  perform  an  understandability  experiment. 

2 .  Methodology  Of  Computer  Program 

The  computer  model  simulates  the  two  different 
types  of  electronic  jamming  selected  for  this  experiment. 
The  computer  program  is  included  as  Appendix  A  and  is 
written  in  FORTRAN.   The  data  file  containing  the  eight  bit 
computer  codes  for  each  character  are  shown  in  Appendix  B. 
The  program  was  run  on  a  PDP-11/70  in  the  Command,  Control 
and  Communications  (C3)  Lab  at  the  Naval  Postgraduate  School. 
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The  program  design  is  as  shown  in  Figure  2.   Explanatory 
comments  are  provided  throughout  the  program  for  the  reader. 

Basically,  the  computer  program  reads  a  message  in 
a  data  file,  translates  each  character  in  the  message  into 
its  eight  bit  code  of  l's  and  O's,  garbles  or  jams  each  bit 
based  on  the  probability  of  jamming  specified  by  the  user, 
and  then  retranslates  the  garbled  bits  into  whatever  charac- 
ters they  have  now  become.   The  eight  bit  code  that  was  used 
is  one  parity  bit  and  the  seven  bit  ASCII  code.   The  garbling 
or  jamming  of  the  information  bits  and  hence,  characters,  is 
independent  of  the  format  of  the  message  that  is  read  into 
the  computer  program.   The  program  just  reads  a  file  con- 
taining characters  and  spaces,  garbles  the  file  at  the 
level  according  to  the  program's  algorithm,  and  retranslates 
the  bits  back  into  characters. 

The  program  is  written  so  that  the  user  can  specify 
either  continuous  or  burst  jamming.   If  continuous  jamming 
is  selected,  the  program  then  asks  the  user  what  probability 
of  jamming  to  use.   After  P(J)  is  specified,  the  program 
then  proceeds  to  read,  garble,  and  print  the  "jammed" 
message.   If  burst  jamming  is  selected,  the  program  asks 
the  user  to  specify  three  parameters:   the  number  of  bits 
between  each  burst,  the  length  of  the  burst  in  bits,  and 
the  probability  of  jamming.   After  the  user  inputs  his 
answers,  the  program  again  reads,  garbles,  and  prints  the 
"jammed"  message.   In  the  burst  mode,  the  program  jams  the 
number  of  bits  in  the  burst,  skips  the  number  of  bits  between 
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bursts,  and  then  repeats  the  process.   So  the  bursts  can  be 
very  far  apart  or  they  can  be  close  enough  to  approach  the 
continuous  jamming  case. 

The  program  is  written  so  that  any  number  of  messages 
can  be  processed  from  a  file.   The  messages  must  be  separated 
by  a  '$'  in  the  first  column  of  the  line  separating  the  end 
of  one  message  and  the  beginning  of  the  next.   In  this  manner, 
the  program  will  keep  reading  messages  until  it  reaches  the 
end  of  the  file.   There  is  no  special  character  to  denote  the 
end  of  file;  the  program  stops  after  the  last  line  of  the 
last  message.   A  sample  input  showing  a  file  containing  two 
messages,  one  JINTACCS  and  one  plain  text,  is  shown  in 
Appendix  C.   A  sample  output  file  of  these  same  messages 
after  continuous  jamming  with  P(J)  =  0.01  (1.0%)  is  shown 
in  Appendix  D.   A  sample  output  file  using  burst  jamming 
with  100  bits  between  each  burst,  a  25  bit  burst  length  and 
P(J)  =  0.10  (10.0%)  is  shown  in  Appendix  E.   It  is  then  a 
simple  matter  to  send  the  output  file  to  a  printer  to  obtain 
a  hard  copy  of  the  jammed  messages. 
3.   Artificiality  Of  The  Model 

Any  simulation  model  should  reflect  reality  as 
accurately  as  possible  or  feasible.   The  further  the  model 
is  from  reality  or  the  more  limitations  the  model  has,  the 
less  credibility  it  has  as  a  model.   As  long  as  the  user  is 
aware  of  a  model's  limitations,  and  the  limitations  are  not 
too  severe,  the  model  can  still  be  a  very  useful  tool.   The 
computer  model  to  simulate  continuous  and  burst  jamming  for 
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this  experiment  has  four  limitations  that  the  reader 
should  be  aware  of. 

The  first  constraint  of  the  computer  model  is  that 
carriage  returns  and  line  feeds  were  not  allowed  to  be 
jammed.   The  model  reads  and  garbles  a  line  of  text  after 
it  has  determined  the  last  non-space  character  in  the  line. 
It  then  reads  the  next  line  of  text,  finds  the  last  character 
in  the  line,  proceeds  to  garble  that  line,  and  the  process 
is  repeated  until  it  reaches  the  end  of  the  message.   If  the 
model  were  to  include  the  carriage  return  in  the  jamming 
process,  the  model  could  end  up  printing  one  line  over 
another  if  the  carriage  return  were  garbled.   If  all  the 
carriage  returns  in  a  message  were  garbled,  a  twenty  line 
message  would  have  all  twenty  lines  printed  on  the  first 
line  of  the  output  file.   This  over-printing  would  obviously 
be  useless  to  try  to  decipher  and  it  would  not  matter  whether 
the  characters  had  been  garbled  or  not.   This  over-printing 
problem,  although  it  would  happen  in  reality,  was  therefore 
not  considered  useful  to  include  in  the  model.   The  purpose 
of  the  jamming  is  to  see  if  one  message  format  is  more 
understandable  than  another  given  the  same  amount  of  charac- 
ter garbling  on  each.   If  all  the  lines  were  over-printed, 
there  would  be  no  way  to  differentiate  the  two  message 
formats . 

The  second  constraint  of  the  model  is  the  number 
of  characters  that  were  included  in  the  computer  program's 
translation  table.   The  table  is  shown  in  Appendix  B  and 
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the  reader  will  note  that  only  capital  letters  were  used. 
This  is  realistic  since,  the  teletype  equipment  used  by  the 
military  to  process  messages  uses  only  capital  letters. 
The  limitation  is  that  there  are  more  special  characters  in 
the  table  than  are  available  on  a  standard  tactical  military 
teletype  keyboard.   With,  the  advent  of  optical  character 
readers  that  use  the  IBM  Selectric  character  set  found  in 
many  fixed  base  military  communications  centers,  the  charac- 
ter sets  are  almost  the  same.   However,  the  fact  remains 
that  for  the  tactical  environment  in  which  JINTACCS  will  be 
used,  the  number  of  characters  available  is  less  than  that 
shown  in  the  model.   This  limitation  is  considered  minor 
when  one  considers  that  once  one  or  more  of  the  bits  in  a 
character  are  garbled,  the  character  is  retranslated  into 
whatever  character  it  has  now  become.   It  does  not  really 
matter  which  new  character  is  printed.   In  other  words, 
once  a  character  is  translated  from  its  original  state,  it 
does  not  matter  what  character  is  now  printed  because  one  has 
no  clue  as  to  what  the  character  was.   The  job  of  trying  to 
decipher  and  understand  the  jammed  message  is  the  same 
regardless  of  the  character  set  used. 

The  third  limitation  is  also  considered  a  minor  one. 
The  model  is  written  such  that  after  the  bits  in  a  character 
are  garbled,  it  searches  the  data  table  to  see  what  character 
the  bits  have  now  become.   If  it  does  not  find  a  character 
match,  the  model  prints  a  space  for  that  character.   The 
selection  of  a  space  for  an  unknown  character  was  purely  an 
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arbitrary  selection.   The  selection  had  to  be  made  because 
it  was  and  is  unknown  as  to  what  a  printer  would  print  if 
the  bits  do  not  match  any  known  character.   There  is  the 
additional  problem  of  the  possibility  that  the  bits  might 
be  translated  into  a  control  character  of  some  type  that 
affects  machine  processing  or  the  printer  itself.   This  could 
have  a  disastrous  effect  on  a  printer  if  it  occurred.   The 
selection  of  the  space  character  for  an  unknown  character 
seemed  proper,  therefore,  and  this  constraint  was  considered 
minor  in  light  of  the  overall  need  to  produce  jammed  messages 
for  the  experiment. 

The  fourth  and  final  limitation  of  the  computer  model 
is  the  exclusion  of  any  kind  of  coding  for  bit  error  detection 
and  correction.   Coding  is  one  of  the  techniques  available  to 
overcome  jamming.   It  is  the  addition  of  one  or  more  extra 
bits  after  so  many  information  bits  to  provide  a  parity  check 
on  the  previous  information  bits.   These  extra  check  bits  are 
redundant  since  they  carry  no  additional  information  other 
than  the  check  data.   Many  modern  data  communications  systems 
take  advantage  of  bit  error  correction  codes  to  provide  for 
the  automatic  identification  and  correction  of  any  trans- 
mission errors  introduced  into  the  system.   The  use  of  these 
avoids  the  need  for  retransmission  of  a  message  since  the 
errors  can  be  detected  and  corrected  at  the  receiver.   There- 
fore time  is  saved  in  communicating  a  message,  and  the 
communications  channel  is  conserved  by  transmitting  each 
piece  of  information  one  time  only.   Two  types  of  bit  error 
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detection  and  correction  codes  that  could  be  used  are  the 
Hamming  code  and  the  Bose ,  Claudhuri  and  Hocquergem  or  BCH 
code.   If  a  type  of  coding  had  been  considered  in  the  model, 
it  would  have  been  able  to  detect  and  correct  errors  intro- 
duced by  the  jamming  up  to  a  certain  point.   Beyond  that 
point,  that  is,  after  so  many  errors  had  been  introduced, 
the  coding  would  not  be  able  to  correct  them.   For  example, 
using  a  Hamming  (7,4)  code,  there  are  4  information  bits 
and  3  check  bits  for  a  total  of  7  bits  per  codeword [Ref .  15]. 
This  Hamming  (7,4)  code  will  detect  and  correct  1  error  in 
the  7  bits,  which  can  be  equated  to  a  probability  of  jamming 
of  1/7  or  about  14.3%.   Therefore,  this  code  could  overcome 
up  to  a  14.3%  rate  of  jamming;  beyond  that  it  could  do  no 
good.   Since  the  type  of  coding  in  use  varies,  the  level  or 
amount  of  jamming  each  code  could  overcome  can  be  calculated 
fairly  easily  and  the  appropriate  level  of  jamming  can  then 
be  selected  for  the  model.   For  these  reasons,  a  bit  error 
detection  and  correction  code  was  not  selected  nor  used  in 
the  computer  model. 

F.   SUMMARY 

The  purpose  of  this  thesis  is  to  investigate  the  suscep- 
tibility of  the  JINTACCS  message  format  to  electronic  jamming. 
The  investigation  consists  of  an  experiment  that  compares  the 
unde r stan dab ility  of  the  JINTACCS  message  format  to  a  plain 
text  message  format  given  equal  amounts  of  jamming  to  each. 
The  need  for  this  research  arises  from  the  fact  that  the 
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JINTACCS  message  standards  are  in  the  development  stage  and 
are  due  for  implementation  by  all  services  in  1985.   In 
addition,  electronic  jamming  of  our  tactical  data  communi- 
cations is  more  of  a  possibility  in  today's  world.   It  is 
therefore  critical  to  know  that  these  new  JINTACCS  message 
formats  are  at  least  as  effective  in  communicating  informa- 
tion in  a  jamming  environment  as  a  plain  text  non-formatted 
message.   In  the  joint  tactical  environment,  communicating 
and  understanding  critical  information  between  force  elements 
directly  affects  mission  success.   We  need  to  verify  that  we 
are  not  adversely  affecting  our  capability  to  succeed. 

The  object  of  this  research  is  to  provide  a  realis- 
tic test  of  the  understandability  of  one  type  of  JINTACCS 
message  format  applicable  to  Air  Force  operations.   It  is 
hoped  that  this  research  effort  will  provide  valuable 
information  to  both  Air  Force  and  other  service  decision 
makers  that  would  otherwise  not  be  available. 
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II.   DESCRIPTION  OF  THE  EXPERIMENT 

A.  OBJECTIVES  AND  CONSTRAINTS 

The  object  of  this  experiment  is  to  compare  the  effec- 
tiveness of  the  JINTACCS  message  format  to  a  plain  text 
message  format  in  an  environment  subjected  to  a  certain  amount 
of  jamming.   Effectiveness  is  measured  as  a  subjective  rating 
of  the  degree  of  understandability  of  those  pieces  of  criti- 
cal information  contained  in  each  message.   The  critical 
information  in  one  message,  format  may  not  be  in  the  same 
field  or  fields  as  in  another  message  format  so  that  the 
effectiveness  rating  considers  the  entire  message.   Speci- 
fically, the  experiment  was  designed  to  determine  if  there 
was  any  significant  difference  in  understandability  between 
JINTACCS  formatted  messages  and  plain  text  non-formatted 
messages  after  each  had  been  subjected  to  equal  levels  of 
two  types  of  jamming. 

■The  experiment  was  constrained  by  the  facilities  avail- 
able to  the  Tactical  Air  Forces  Interoperability  Group 
(TAFIG).  at  Langley  AFB ,  Virginia,  and  the  C3  Laboratory  at 
the  Naval  Postgraduate  School  (NPS)  . 

B.  SUBJECTS 

Two  groups  of  subjects  were  used  for  the  experiment.   A 
pilot  trial  was  conducted  at  NPS  using  student  volunteers. 
The  main  experiment  was  conducted  at  Langley  AFB  with  a 
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second  group  of  military  subjects  on  a  temporary  duty 
training  to  use  JINTACCS . 

The  pilot  trial  group  consisted  of  16  military  officers 
representing  the  Air  Force  (9).,  Army  (4),  and  Navy  (3).   The 
officers  included  15  males  and  1  female.   Their  grades  ranged 
from  Captain  to  Major  and  Lieutenant  to  Lieutenant  Commander. 
The  subjects'  ages  ranged  from  29  to  39  with  an  average  age 
of  33.   Their  length  of  service,  varied  from  6  years  to  14 
years  with  an  average  length  of  military  service  of  9.5 
years.   All  of  the  subjects  in  the  pilot  trial  were  enrolled 
in  the  Command,  Control  and  Communications  Curricula  at  NPS  . 
Their  backgrounds  were  quite  varied  including  communications, 
missile  combat  crew  commander,  computers,  weapons  control, 
electronic  warfare,  navigation,  artillery,  infantry,  surface 
warfare,  and  naval  flight. 

The  second  group  of  subjects  at  Langley  AFB  consisted  of 
25  military  officers  representing  the  Air  Force  (18) ,  Navy 
(2) ,  Marines  (1) ,  Air  National  Guard  (3) ,  and  Air  Force 
Reserves  (_1)  .   There  were.  2  4  males  and  1  female.   Their 
grades  ranged  from  2nd  Lieutenant  to  Lieutenant  Colonel  and 
Lieutenant  to  Lieutenant  Commander.   The  subjects'  ages 
ranged  from  24  to  44  with  an  average  age  of  31  years  old. 
Their  length  of  service  varied  from  2  years  to  22  years 
with  an  average  of  11  years  of  military  service.   The  back- 
grounds of  the  subjects  in  the  second  group  also  varied 
widely. 
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The  second  group  of  subjects  were  on  temporary  duty 
(TDY)_  at  Langley  AFB  to  receive.  JAMPS  training  and  to  then 
participate  in  an  Air  Operations  Interoperability  Test  of 
the  JINTACCS  message  standards.   The  subjects'  experience 
in  their  operational  facility  ranged  from  no  experience  to 
six  years  and  no  exercise  participation  to  approximately  20 
exercises.   Only  a  handful  of  the  subjects  had  JAMPS  training 
prior  to  this  experiment,  so  the  majority  were  seeing  JAMPS 
for  the  first  time  and  were  in  the  initial  training  mode. 

C.   EQUIPMENT 

1.   JAMPS  Terminal 

The  computer  system  at  Langley  AFB  that  was  used  for 
this  experiment  consisted  of  numerous  terminals  connected  to 
a  Digital  Equipment  Corporation  (DEC)  PDP-11/70  computer. 
The  computer  terminals  were  Perkin-Elmer  Owl  1200' s,  which 
are  the  standard  view  screen  and  keyboard  terminals  common 
today.   Their  display  is  a  12-inch  diagonal  inverse  video 
(white-on -black  or  black-on -white),  cathode  ray  tube  (CRT) 
[Ref .  17] .   The  keyboard  is  fixed-alphanumeric  with  16 
(shif table  to  32)  functional  control  keys  and  6  additional 
function  keys  collocated  with  alphanumeric  keys  [Ref.  18]. 
The  terminal  can  display  24  lines  with  80  characters  per 
line. 

The  keyboard  of  the  JAMPS  terminal  is  divided  into 
two  basic  groups,  alphanumeric  keys  and  function  keys.   The 
alphanumeric  keys  are  used  by  the  JAMPS  operators  to  create 
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and  enter  the  data  for  any  or  all  fields  of  a  JINTACCS - 
formatted  message  [Ref.  19].   They  are  like  those  keys  on 
a  standard  typewriter  keyboard.   The  function  keys  are  used 
for  editing,  verification  and  transmission  of  the  various 
JINTACCS -formatted  messages  [Ref.  20],   These  keys  are 
color  coded  and  dual  action,  requiring  upper  and  lower  case 
operation. 

2.   JAMPS  Operation 

The  operation  of  the  JAMPS  terminal  is  fairly 
straightforward.   After  the  operator  is  logged  on,  he  simply 
types  'JAMPS'  to  initiate  the  JAMPS  program.   A  menu  showing 
a  category  selection  list  appears  on  the  display  and  the 
operator  can  choose  the  type  of  action  he  wants  to  accomplish 
(see  Figure  3) .   The  operator  can  choose  one  of  six  different 
types  of  message  formats,  messages  that  have  been  saved,  a 
transmitted  message  file,  a  received  message  file,  or  he  can 
quit. 

If  the  operator  chooses  one  of  the  six  types  of 
JINTACCS  messages,  he  is  then  presented  with  a  submenu 
display  of  all  the  available  messages  within  the  desired 
category.   An  example  of  a  partial  submenu  display  for  Air 
Operations  messages  is  shown  in  Figure  4. 

From  this  submenu,  the  operator  chooses  the  message 
number  of  the  desired  message,  and  the  blank  message  tem- 
plate is  displayed.   An  example  of  the  blank  message  tem- 
plate for  number  A6  5  0  or  Apportionment/Allotment  Message 
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ADMIN    UNCLASSIFIED  00ADMI    ATM  IN 


1  AIM  IN 

2  AIR  OPERATIONS 

3  GPS  CONTROL 

4  INTEL 

I  FIRE  SUPPORT 

6  AMPHIB 

?  Messages  Savea 

e  Messages  Transri tied 

9  Messages  Received 

12  ***  Quit  *** 


Pigure  3.   JAMPS  CATEGORY  SELECTION  MENU  DISPLAY 
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AIROPS    UNCLASSIFIED  00AIRO    AIROPS — 


MSG-NO  MESSAGE  TITLE 

FS41  Acknowledge  Message  lAKNLDGj 

E710  Air  Defense  Command  Message  [ARDEFCOM] 

E7ie  Air  Defense  Warning  Message  [AIRDEFWARN] 

A651  Air  Employment/Allocation  Plan  [EMPLOYALOCj 

A661  Air  Mission  Request  Status/Tasking  Message  [RECSTSTSK] 

B704  Airbase  Change  Report  [ABCHAMGEj 

F631  Airlift  Mission  Schedule  fALMSNSCD] 

D630  Airlift  Request  lALRECj 

B70b  Alert  Aircraft/SAM  Status  Report  [ACSAMSTAT] 

A770  Alert  Launcn  Oraer  [ALORDj 

A650  Apportionment/Allotment  Message  [APORALOT] 

F6£4  Cross-Force  Mission  Data  Confirmation  Message  [CROSSCONF] 

A653  Cross-iorce  Mission  Data  Message  [CROSSDATj 

F750  Designated  Area  Message  IDFSIGARFA] 

F7S1  ECM  Data  Message  [ECMDATJ 

E711  Engagement  Status  fENGSTS] 

F632  Flight  Control  Information  Message  [FLTCONTINFO] 


Figure  4.   JAMPS  AIR  OPERATIONS  SUEMFNU  (Not  Complete) 
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(APORALOT) ,  which  is  an  air  operations  message  format,  is 
shown  in  Figure  5 . 

The  operator  can  then  compose  and  type  his  message. 
He  can  fill  in  the  blanks  in  the  format  shell  or  "mask"  mode 
or  he  can  select  either  a  "help"  mode,  or  a  "conversation" 
mode  which  will  assist  him  in  filling  in  the  complete  message. 
The  mask  mode  is  designed  for  the  more  experienced  JAMPS 
operator.   The  help  mode  allows  the  experienced  operator  to 
review  the  meaning  of  a  single  field  or  the  type  of  data  to 
be  entered  in  that  field.   The  operator  can  jump  back  and 
forth  between  the  mask  and  help  modes.   The  conversational 
mode  is  designed  to  provide  detailed  instruction  to  the 
novice  user  by  guiding  the  operator  through  the  message  in 
a  field-by-field  manner  [Ref .  21] . 

D.   MESSAGES  USED  FOR  THE  EXPERIMENT 

As  stated  previously,  there  are  six  categories  of 
JINTACCS  messages.   These  are  administrative,  air  operations, 
operations  control,  intelligence,  fire  support,  and  amphib- 
ious.  Since  the  test  subjects  were  at  Langley  AFB  for  an 
Air  Operations  Interoperability  Test,  the  air  operations 
messages  were  chosen  for  this  experiment.   An  alphabetical 
list  of  the  JINTACCS  air  operations  messages  as  of  3Q  July 
1981  is  shown  in  Appendix  F  [Ref.  22].   For  the  experiment, 
the  following  air  operations  messages  were  used:  acknowledge 
message,  airlift  request,  search  and  rescue  incident  report, 
airbase  change  report,  message  change  report,  sortie  allotment 
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A650G01A  xxxxxxxxxxxxxx  Z6JA65K  A65£GeiA 

FROM/PLA:  /RI: 

/ADER:  /CLASS: 

/PRIPREC:  _  /SECPREC:  _  /ETG  :  // 

TC/PLA:  /HI: 

/AEER:  // 

INiO/PIA:  /RI: 

/AEER:  // 

CLASS/CLAS:  UNCLAS 

/EESIGNATOR:  // 

SIC/SID-CODI:  ___  // 

EXER/EXERCISE: 

/EXER-AEE:  // 

OFER/OPEP.ATION  NAME: 

/GPLNNO:  /OPT-NICKNAfE: 

/SEC-OPT-NICKNAME:  // 

MSGID/MSG-TITLE:  APCRALCT  /MSG-ORIG: 

/MSG-SER-NUM:  /NM'HNM: /CLP: /SERNUM: // 

REF/MSG-TITLE:  /;-.SG-C?.IG  : 

/BATI-TIMI-RIF:  /PNTENM: /MSG-SER-NUM : /SIC 

/SPEC-NCT:  // 


Figure  5.   JIKTACCS  APPCRT ICNMEKT/ALLCTMENT  (APORALOT) 
BLANK  MESSAGE  TEMPLATE  EISPLAY 
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message,  alert  aircraft/SAM  status  report,  cross  force 
mission  data  message,  request  confirmation  message,  flight 
control  information,  and  request  status  task  message. 

The  messages  used  for  the  experiment  were  made  up  with 
the  same  information  in  each  format.   For  example,  an  airlift 
request  message  was  made  up  using  the  proper  JINTACCS  message 
format.   It  is  shown  in  Figure  6.   The  same  information  was 
then  rewritten  in  a  plain  text  or  plain  English  message,  as 
shown  in  Figure  7.   In  this  manner,  each  message  contained 
exactly  the  same  critical  information  but  was  packaged 
differently.   Specific  questions  could  be  asked  of  a  test 
subject  to  determine  the  amount  of  critical  information  the 
subject  could  extract,  given  equal  levels  of  garbling  to 
each  message  type. 

E.   EXPERIMENTAL  PROCEDURE 

1 .   Conduct  Of  The  Experiment 

The  experiments  were  conducted  in  two  phases;  pilot 
trials  at  NPS  and  main  experiment  trials  at  Langley  AFB . 
The  procedures  used  for  each  are  described  separately  below. 

For  the  pilot  trials,  the  subjects  were  given  indi- 
vidual message  packets  to  complete.   Each  packet  contained 
five  plain  text  messages  that  had  been  garbled  at  different 
levels  of  continuous  and  burst  jamming.   No  JINTACCS  messages 
were  included  in  these  pilot  trial  packets  since  the  subjects 
had  received  no  JINTACCS  training  nor  was  any  JINTACCS 
material  available  for  their  use.   Each  packet  was  arranged 
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so  that  it  contained  five  sets  of  garbled  messages  and 
questionnaires  on  the  critical  pieces  of  information.   The 
questionnaire  for  a  message  immediately  followed  each 
message.   The  questionnaire  had  from  6  to  19  short  answer 
f ill-in-the-blank  questions.   The  questions  were  worded  to 
minimize  the  possibility  of  leading  the  subject  or  helping 
him  deduce  the  answer  from  the  garbled  message  or  from  the 
other  questions.   A  sample  questionnaire  used  for  the 
airlift  request  message  is  shown  in  Figure  8. 

The  subjects  were  given  instruction  sheets  stapled 
to  the  front  of  the  packet.   They  were  told  that  the  reason 
for  conducting  this  experiment  was  to  determine  the  under- 
standability  of  these  messages  at  various  levels  of  jamming. 
Their  responses  would  be  examined  to  estimate  how  message 
under standability  is  affected  by  jamming.   They  did  not  know 
how  much  jamming  each  message  had  been  subjected  to,  nor  did 
they  know  which  type  of  jamming  had  been  used  on  any  message, 
The  instruction  sheet  explained  that  the  messages  in  the 
packet  had  been  garbled  by  a  computer  model  that  simulates 
electronic  jamming.   The  sheet  instructed  them  to  do  two 
things.   First  they  were  to  read  the  message  and  correct  any 
garbled  letters  as  best  they  could  by  writing  the  correct 
letters  above  the  bad  ones.   It  was  felt  that  by  correcting 
the  garbled  letters,  they  would  be  forced  to  work  more  to 
decipher  the  garbled  message  and  understand  it.   Secondly, 
the  subjects  were  instructed  to  answer  the  questions  concern- 
ing each  message  to  the  best  of  their  ability. 

44 


1.  WHAT  TYPE  OF  MESSAGE  IS  THIS? 

2.  WHAT  IS  THE  FIRST  ACTION  CITID  EY  THIS  MESSAGE? 

3.  HOW  MANY  AIRCRAFT  ARE  RSQUESTEL? __. 

4.  WHAT  KIN!  OF  AIRCRAFT  ARE  REQUESTED? 

5.  WHERE  WILL  THE  AIRCRAFT  BE  ONLOADED? 

6.  WHAT  KIND  CF  CARGO  IS  BEING  ONLOADED? 

7.  WHAT  IS  THE  HAZARD  TYPE  OF  THE  CARGO  BEING  ONLOADED? 

6.  IS  'SINGLE  DAGGER"  REQUIRED? YES   NO 

y.  WHERE  WILL  THE  AIRCRAFT  3E  0**  LOADED?  __. . 

10.  WHAT  FREQUENCY  IS  TO  BE  USED  PRIOR  TO  LANDING? 

11.  WBAT  SPECIAL  EQUIPMENT  IS  REQUIRED? 


Figure  8.   SAMPLE  QUESTIONNAIRE  FOR  AIRLIFT  REQUEST  MESSAGE 
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The  intent  of  the  pilot  trials  was  to  determine  the 
amounts  of  continuous  and  burst  jamming  that  should  be  used 
for  the  main  experiment.   If  too  little  jamming  were  used, 
it  was  felt  that  no  difference  in  understandability  would 
result.   Likewise  if  too  much  jamming  were  used,  both  message 
types  would  be  so  garbled  that  neither  would  be  understandable 
and  again  there  would  be  no  difference  between  JINTACCS  and 
plain  text  messages.   If  any  difference  in  understandability 
between  the  two  message  types  exists,  it  was  believed  that 
the  difference  would  be  most  noticeable  at  that  point  just 
before  all  understandability  decreases  rapidly.   It  was 
hypothesized  that  a  plot  of  understandability  versus  the 
amount  of  jamming  would  result  in  curves  like  those  in 
Figure  9  for  continuous  and  burst  jamming.   The  amount  of 
jamming  used  for  the  main  experiments  should  therefore  be  in 
the  vicinity  of  the  asterisks  marked  on  the  two  plots. 

The  experimental  procedure  was  essentially  the  same 
for  the  main  experiment  at  Langley  AFB  with  the  second  group 
of  subjects.   They  were  told  that  the  experiment  was  being 
conducted  to  determine  if  there  was  any  significant  difference 
in  understandability  between  JINTACCS  messages  and  messages 
that  were  written  in  plain  text  given  an  equal  amount  of 
garbling  or  jamming  to  each.   Each  subject  was  given  a  packet 
containing  six  JINTACCS  messages  and  six  plain  text  messages 
and  each  group  of  six  messages  was  labeled.   The  subjects 
were  instructed  to  correct  the  garbled  letters  as  best  they 
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Figure  9.   HYPOTHESIZE!  CONTINUOUS  AND  EURST  JAMMING  CURVES 


47 


could  by  writing  the  correct  letters  above  the  bad  ones  for 
each  message  and  to  answer  the  questions  for  each  message  to 
the  best  of  their  ability.   The  instruction  sheet  is  shown 
in  Appendix  G. 

The  subjects  at  Langley  AFB  were  allowed  to  use  the 
JAMPS  computer  terminals  to  aid  in  deciphering  the  JINTACCS 
group  of  messages  in  their  packet.   In  this  manner,  if  they 
could  determine  what  type  of  message  they  were  working  on, 
they  could  select  that  format  on  the  JAMPS  terminal  and  have 
the  blank  format  displayed.   With  the  display  they  then  knew 
what  type  of  information  was  supposed  to  be  in  each  field. 
This  should  enhance  their  ability  to  decipher  the  JINTACCS 
messages.   When  working  on  the  plain  text  messages,  the 
subjects  had  no  computer  aids  to  he.lp  in  deciphering  the 
garbled  messages.   The  amount  of  jamming  used  in  the  main 
experiment  was  determined  from  the  pilot  trials  at  NPS . 

The  subjects  were  given  a  time  limit  to  add  some 
realism  to  their  tasks.   They  were  allowed  60  minutes  per 
message  group  or  an  average  of  1Q  minutes  per  message.   The 
time  pressure,  although  artificial,  was  an  attempt  to  provide 
a  surrogate  for  the  pressure  a  subject  might  encounter  in  a 
tactically  deployed  battlefield  environment.   However,  since 
it  was  important  for  the  subjects  to  finish  the  messages, 
and  since  they  were  not  being  tested  for  speed,  the  subjects 
who  were  not  done  in  6Q  minutes  were  allowed  to  finish. 
They  did  not  know  in  advance  that  they  would  be  given  extra 


48 


time  to  finish.   Only  a  few  took,  longer  than  the  alloted 
time. 

2.   Experiment  Description 

The  overall  experiment  can  he  divided  into  basically 
three  separate  sub-experiments.   The  first  sub -experiment 
was  conducted  at  NPS  and  there  were  two  trials,  called  the 
pilot  trials.   Pilot  trial  1  used  plain  text  messages  with 
continuous  jamming  at  0.5%,  l.Q%,  1.5%,  2.0%,  2.5%,  3.0%, 
3.5%,  4.0%,  4.5%  and  5.0%  (the  values  represent  the  proba- 
bility of  garbling  an  individual  bit)  .   Pilot  trial  2  used 
plain  text  messages  with  two  types  of  burst  jamming  at  the 
1.0%,  3.0%,  5.0%,  7.0%,  10.0%  and  20.0%  levels. 

The  second  sub -experiment  was  conducted  at  Langley 
AFB  and  there  were  three  trials.   Trail  1  was  the  control 
group;  each  subject  had  JINTACCS  and  plain  text  messages 
with  no  jamming.   These  trials  were  used  to  determine  if 
there  were  differences  in  understandability  due  to  the  type 
of  format  even  if  no  jamming  were  applied.   Trial  2  was  the 
test  of  JINTACCS  versus  plain  text  at  the  1.0%  level  of 
continuous  jamming,  at  the  5.0%  level  of  burst  jamming  with 
100  bits  between  bursts  and  25  bits  in  the  burst,  and  at  the 
5.0%  level  of  burst  jamming  with  2Q0  bits  between  bursts 
and  50  bits  in  the  burst.   Trial  3  was  conducted  to  estimate 
the  understandability  curves  for  JINTACCS  messages.   It 
tested  continuous  jamming  from  the  0.5%  to  3.0%  levels, 
burst  jamming  with  100  bits  between  bursts,  25  bits  in  the 
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burst,  and  from  3.0%  to  20.0%  levels  of  jamming,  and  burst 
jamming  with  200  bits  between  hursts,  5Q  bits  in  the  burst, 
and  from  3.0%  to  20.0%  levels  of  jamming. 

The  third  sub-experiment  was  also  conducted  at 
Langley  AFB  and  was  essentially  a  follow-up  test  for  the 
second  sub-experiment.   There  were  two  reasons  for  this 
third  sub-experiment.   First,  the  majority  of  test  subjects 
had  received  minimal  training  (one  and  a  half  days)  before 
the  second  sub-experiment.   Any  differences  between  JINTACCS 
and  the  plain  text  messages  might  not  be  directly  attributable 
to  the  differences  in  formats  and  could  be  of  questionable 
validity  because  of  the  limited  training.   Secondly,  the 
third  sub-experiment  enabled  us  to  estimate  the  understand- 
ability  curves  for  both  JINTACCS  and  plain  text  from  the  same 
test  group.   The  first  sub-experiment  provided  estimates  of 
the  understandability  curves  for  plain  text  messages;  the 
second  sub-experiment  was  used  to  estimate  the  JINTACCS 
understandability  curves.   However,  there  was  no  information 
that  would  enable  us  to  directly  compare  the  message  formats 
because  the  groups  were  different. 

There  were  no  control  group  trials  in  the  third 
sub-experiment.   Trial  2  was  repeated  but  with  the  addition 
of  continuous  jamming  at  the  2.0%  level.   Trial  2  therefore 
provided  comparison  tests  for  two  types  of  continuous  jamming 
and  two  types  of  burst  jamming.   Trial  3  was  a  replication  of 
trial  3  in  the  second  sub-experiment,  but  both  JINTACCS  and 
plain  text  messages  were  used. 

50 


F.  SUBJECT  QUESTIONNAIRE 

An  11  item  subjective  questionnaire  was  given  to  each 
experimental  subject  at  Langley  AFB  after  the  subject  had 
completed  his  message  packet.   The  purpose  of  the  question- 
naire was  to  determine  the  subjects'  attitudes  about  the 
JINTACCS  message  format.   The  questionnaire  is  shown  in 
Appendix  H  and  is  annotated  with  the  average  response  to 
each  question  from  each  sub-experiment.   The  direction  of 
the  shift  from  the  first  to  the  second  sub-experiments  is 
annotated  with  arrows,   +  or  ■*■  . 

G.  DEPENDENT  VARIABLES 

The  measure,  %  understandability ,  was  estimated  for  each 
trial  as  follows : 


N 


2^   TC. 


i  =  1 

%  Understandability   =     x  100 

N 


2^  TQ. 


i  =  1 

where   TC  =  Total  Questions  Answered  Correctly 
Per  Subject  Response 

TQ  =  Total  Questions  Per  Subject  Response 

N  =  Total  Number  of  Subjects 
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H.   HYPOTHESES 

The  following  null  hypotheses  regarding  understandability 
were  tested: 

1.  Hypotheses  Regarding  Understandability 
(All  Sample  Results) 

For  each  category  of  continuous  and  burst  jamming: 

(a)  Ho:  There  is  no  difference  in  the  percent  of 
understandability  between  JINTACCS  and  plain  text  messages 
given  continuous  jamming  at  the  l.Q%  and  2.0%  levels. 

(b)  Ho:  There  is  no  difference  in  the  percent  of 
understandability  between  JINTACCS  and  plain  text  messages 
given  burst  jamming  at  the  5.0%,  7.5%  and  10.0%  levels. 

(c)  Ho:  There  is  no  difference  in  the  percent  of 
understandability  between  JINTACCS  and  plain  text  messages 
given  no  jamming. 

2 .  Hypotheses  Regarding  Understandability 
(Middle  Results  Only). 

After  the  initial  analysis  of  the  data,  the  plain 

text  scores  seemed  to  be  grouped  closer  together  while 

the  JINTACCS  scores  had  a  greater  dispersion  with  some 

scores  which  seemed  to  be  outliers  on  the  low  side.   In 

order  to  determine  if  the  effect  of  the  few  outliers  was 

sufficient  to  alter  the  conclusions  of  the  statistical 

tests  the  upper  and  lower  scores  were  trimmed  from  the 

data  sets  and  the  tests  were  repeated  using  only  the 

middle  50.0%  of  the  scores.   Therefore,  to  determine  if 

there  is  a  difference  in  percent  of  understandability 

when  the  top  and  bottom  scores  are  discarded,  the 
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following  hypothesis  tests  were  conducted  for  each 
category  of  continuous  and  burst  jamming. 

(a)  Ho:   There  is  no  difference  in  the  percent 
of  understandability  between  JINTACCS  and  plain  text 
messages  given  continuous  jamming  at  the  1.0%  and 

2.0%  levels. 

(b)  Ho:   There  is  no  difference  in  the  percent 
of  understandability  between  JINTACCS  and  plain  text 
messages  given  burst  jamming  at  the  5.0%,  7.5%  and 
10.0%  levels. 

I.   EXPERIMENTAL  DESIGN 

The  experiment  was  designed  as  shown  in  Figure  10.   The 
message  packets  were  made  up  to  include  two  groups  of  six 
messages  each.   The  subjects  were  divided  so  that  one  half 
would  start  on  the  JINTACCS  message  group  while  the  other 
half  started  on  the  plain  text  message  group.   This  would 
insure  neither  message  type  received  favorable  treatment  by 
being  first  or  second  all  the  time.   Each  subject  received 
the  same  12  messages,  but  the  messages  were  presented  in  a 
randomized  order.   Each  of  the  12  messages  was  distinct  with 
its  own  information.   In  addition,  no  subject  saw  a  JINTACCS 
message  and  then  saw  that  same  message  in  a  plain  text  format 
in  his  packet.   The  messages  were  balanced  so  they  appeared 
in  the  different  packets  the  same  approximate  number  of  times 
in  the  JINTACCS  and  plain  text  formats.   As  a  result  of  the 
above,  no  two  packets  were  exactly  alike.   While  the  subjects 
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/  /  / 

/   PLAIN  TEXT    /    JINTACCS     / 

/               /  / 

/ / / 

/  /  / 

/  /  / 

/    JINTACCS     /    PLAIN  TEXT   / 
/  /  / 

/  /  / 


JINTACCS 


PLAIN  TEXT 


SUBJECTS 
(HALF  CN  EACH  SIDE) 


/ 

/   MESSAGE  NUMBER 


/ 


figure  10.   CONCEPTUAL  EXPERIMENTAL  DESIGN 
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sat  next  to  each  other  using  the  JAMPS  terminals  for  the 
JINTACCS  messages,  each  subject  worked  on  different  messages 

J.   RESULTS 

The  experimental  results  for  the  understandability  of 
JINTACCS  and  plain  text  messages  are  presented  in  this  sec- 
tion.  The  hypothesis  tests  for  each  type  of  jamming  were 
done  by  comparing  the  two  sample  proportions.   The  test 
statistic  is  [Ref .  23] : 

2  =  (P1  "  P2}-/ap 
where   p,  =  Plain  Text  Proportion 
p2  =  JINTACCS  Proportion 


and 


AIZ~  _    (nx  +  n 

r   =  \p  .  (1  -  p)  •  — 

p     1  *  *'         n1   .  n 


2> 


l2 

where   n,  =  Number  of  Plain  Text  Samples 
n2  =  Number  of  JINTACCS  Samples 

&1   •  P]_  +  ^2  *  P2 


P   = 


nl  +  n2 


Using  a  significance  level  of   a  =  0.10,  the  test  would 
fail  to  reject  the  null  hypothesis  if  -1.645  <  z  <  1.645 
and  would  reject  the  null  hypothesis  if  the  z  value  fell 
outside  this  interval. 

1.   Results  For  Understandability  (All  Sample  Results), 
The  experimental  results  for  the  percent  of  under- 
standability of  JINTACCS  and  plain  text  messages  using  all 
of  the  sample  results  for  the  first  hypothesis  tests  are 
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shown  in  Table  I.   Both  sub-experiments  failed  to  reject 
the  hypothesis  in  every  case,  implying  no  significant 
difference  in  understandability  exists  for  the  two  formats. 
Because  it  appeared  from  the  understandability  curves  at  the 
various  levels  of  jamming  that  the  plain  text  scores  consis- 
tently dominated  the  JINTACCS  scores,  a  Mann-Whitney  U  test 
was  conducted  to  do  a  rank  comparison  of  the  results  [Ref. 
24] .   This  is  one  of  the  more  powerful  nonparametric  tests 
and  is  used  to  determine  whether  two  independent  groups  have 
been  drawn  from  the  same  population  [Ref.  25].   It  is  a  most 
useful  alternative  to  the  parametric  t  test  but  it  does  not 
require  any  of  the  t  test's  assumptions  about  the  populations' 
distributions  nor  their  variances  [Ref.  26].   The  test  sta- 
tistic is  based  on  the  rank  order  from  the  lowest  to  the 
highest  scores  and  it  might  give  different  results  from  the 
proportion  test  if  the  one  set  of  scores  consistently  outrank 
the  others,  even  though  their  averages  may  be  close  together. 
The  result  for  this  test  also  failed  to  reject  the  null 
hypothesis  that  there  was  no  difference  in  understandability 
between  JINTACCS  and  plain  text  messages,  except  for  the 
continuous  1.0%  case  from  sub-experiment  2  trial  2. 

2 .   Results  For  Understandability  (Middle  Results  Only) 
The  experimental  results  for  the  percent  of  under- 
standability of  JINTACCS  and  plain  text  messages  using  only 
the  middle  50%  of  the  sample  results  for  the  second  hypo- 
thesis tests  are  shown  in  Table  II.   These  tests  were  run 
to  see  if  perhaps  there  is  a  difference  when  the  upper  and 
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TAELE  I 
RESULTS  EOR  UNLERSTANDAB ILITY  (ALL  RESULTS) 


*  Type  Of  Jamming 


JINTACCS  !  Plain  Text  !  Z  Value   * 


! 
Sub-Experiment  2   Trial  1 

*  No  Jamming         !   y5.fc3% 

*  (Control  Group) 

Sub-Experiment    2      Tri<=l    2 

*  \ 

*  Continuous  1.0%     ! 


*  Burst  1*32  25  5.01 


*  Burst  200  50  b . 0% 


!  ey.2% 

|       <"  6  .  9  A: 

c  y  •  t  /o 


Sub-Experiment  3   Trial  2 
*  Continuous  1.0% 


*  Continuous    2.0% 

*  Burst    100    2b   7.5% 

*  Burst    200    50    10.0% 


81 .42% 
55.63% 
77.27% 
70.5<i% 


96.57% 


7y.4% 
£2.6% 
£3.y% 


£1.45% 
69.12% 

£0.&% 
70.0% 


0.12(NS  )  * 

! 

!  0.yS(NS)  * 

1  0.42(NS)  * 

!  0.y7(NS)  * 

! 

vj  .002  (NS)* 

0.74(KS )  * 

0.22  IMS)  * 

-0.02(NS)  * 


NS  =  Not  Significant 
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TABLE  II 

RESULTS  FOR  UNDERSTANDABILITY  (MIDDLE  RESULTS) 


*  Type  Of  Jarrrrin^ 


j  JINTACCS  i  Plain  Text  !  Z  Value   * 


SuD-Experiment  2   Trial  2 

*  Continuous  1 .0% 

*  Upper  25% 

*  Middle  50% 

*  Lower  25% 

*  Burst  100  25  5.0% 

*  Upper  25% 

*  Middle  50% 

*  Lower  25% 

*  Burst  200  50  5.0% 

*  Upper  25% 

*  Middle  50% 
Lower  25% 


93.  y% 
72.5% 
48.0% 


90  .y% 

79.1% 
58.8% 

y  O  .  t  /b 

71.4% 


y5.8% 

81.1% 
59.5% 


100.0% 
82.3% 
68.  &% 

100.0% 
81.7% 
70.0% 


0.59(NS )  * 


5? 

0.17(NS  )  * 
0.50  (NS)  * 


NS  =  Not  Significant 


(CONTINUED  CN  NEXT  PAGE) 
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TABLE  II   (CONTINUED) 
RESULTS  FOH  UNLERSTANEABILITY  (MIDDLE  RESULTS) 


*   Type   Of   Jamrring  i    JINTACCS     !    Plain   Text 


i      7 


Value      * 


Sub-Experiment  3 

Trial 

2 

# 

*  Continuous  1.0% 

*< 

*    Upper  25% 

95.7% 

y^  •  u 

# 

*    Middle  50% 

81.5% 

63.6% 

0 

.10  (NS  ) 

* 

*    Lover  25% 

66.0% 

67.7% 

* 

*  Continuous  2.0% 

# 

*    Upper  25% 

87.5% 

9e.5% 

* 

*    Middle  50% 

55.6% 

69.7% 

0 

.58(NS  ) 

* 

*    Lower  25% 

21.7% 

50.0% 

5? 

*  Burst  100  25  7. 

5%   ! 

* 

*    Upper  25% 

91  .9% 

96.9% 

* 

*    Middle  50% 

76.7% 

63.3% 

0 

.31 (NS  ) 

* 

Lower  25% 

62  .9% 

60.6% 

* 

*  Burst  200  5£  10 

.0%  ! 

* 

*    Upper  25% 

66.1% 

y  i  .  ^  /o 

* 

*    "idale  50% 

7  ?i  'z  V 

69.6% 

-0 

.03(NS  ) 

* 

*    Lower  £5% 

54.5% 

53.6% 

* 

NS    =   Net    Significant 
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lower  scores  are  discarded.   Again  both  sub-experiments 

failed  to  reject  the  hypothesis  in  every  case,  implying  no 

significant  difference  in  understandability  exists  for  the 

two  formats. 

3 .   Results  For  Continuous  Jamming  (JINTACCS  Versus 
Plain  Text) 

Although  the  plots  of  percentage  of  understandability 
versus  jamming  percentage  generally  follow  the  hypothesized 
continuous  jamming  curve  shown  in  Figure  9,  there  are  some 
features  of  the  curves  unexpected  by  the  experiment.   A  plot 
of  the  percent  of  correct  answers  versus  the  amount  of  con- 
tinuous jamming  is  shown  in  Figure  11.   The  plain  text  results 
are  from  the  pilot  trials  at  NPS  and  the  JINTACCS  results  are 
from  sub-experiment  2  at  Langley  AFB.   A  plot  of  their  dif- 
ferences at  each  level  of  jamming  is  shown  in  Figure  12.   As 
can  be  seen  from  these  plots,  the  plain  text  scores  were 
higher  at  almost  all  levels  of  jamming.   However,  since  the 
results  for  plain  text  were  from  a  different  group  of  test 
subjects  than  the  JINTACCS  results,  no  firm  conclusions  can 
be  drawn. 

The  plot  of  the  results  from  sub-experiment  3,  where 

all  responses  are  from  the  same  test  subjects,  showed  even 

more  intriguing  results.   The  plot  of  the  two  curves  is 

shown  in  Figure  13  and  the  plot  of  the  difference  curve  is 

shown  in  Figure  14.   As  the  reader  can  see  from  these  plots, 

the  plain  text  results  were  more  understandable  with  light 

jamming  but,  at  higher  levels  of  jamming  (>1.5%) ,  JINTACCS 

messages  were  more  understandable.   A  possible  reason  for 

60 


y0  - 


£0  - 


70  - 
Per  Cent 


Correct 


Answers 


7M  - 


20 


20  - 


10  - 


0  +■ 


5    ! 
.75 


1.0   | 


1.5 


.0 


3.0 


1.25 


Per  Cent  Of  Jamming 


JINTACCS   (LANGLEY  AFB) 
Plain  Text  (NPS) 


Figure  11.   PLOT  OF  CONTINUOUS  JAMMING  RESULTS  (FIRST  PART 


61 


DIFFERENCE  CURVE   {PLAIN  TEXT  -  JINTACCS} 


Difference 


In  Per  Cent 


-13  - 


-1  k.  - 


-20  - 


Per  Cent  Of  Jamming 


Figure  12.   PLCT  OP  CONTINUOUS  DIFFERENCE  CURVE  (FIRST  PART) 


62 


100  - 


70  - 
Per  Cent 


Correct 


Answers 


60  - 


40  - 
30  - 
20  - 
10  - 

0 


•+ +■ 


5    1   1.0   1   1.5 

.75      1.25 


2.0 


H  — 

3.0 


Per  Cent  Of  Jailing 


JINTACCS   (LANGLEY  AFB) 
Plain  Text  (LANGLEY  AFB) 


Figure  13.   PLOT  OF  CONTINUOUS  JAMMING  RESULTS  (SECOND  PART) 


63 


^e  - 


it 


k  _. 


10  - 


5  - 


Difference 

0  + 
In  Per  Cent 


_  £■      _ 


-10   " 


-15  - 


-20  - 


DIFFERENCE  CURVE   {PLAIN  TEXT  -  JINTACCS} 


Per  Cent  Of  Jamming 


Figure  14.   PLOT  OF  CONTINUOUS  DIFFERENCE  CURVE  (SECOND  PART/ 


64 


this  change  from  the  earlier  experiment  is  the  amount  of 
training  the  subjects  had  received.   By  the  time  of  the 
third  sub-experiment,  the  subjects  had  received  a  significant 
amount  of  training  since  the  second  sub-experiment.   The 
additional  training  and  familiarity  with  the  JINTACCS  format 
and  the  JAMPS  computer  terminals  and  the  JINTACCS  format 
itself  might  account  for  their  ability  to  recover  more  infor- 
mation given  an  increased  amount  of  jamming. 

A  plot  of  all  four  results  on  the  same  graph  is 
shown  in  Figure  15  for  the  reader's  review. 

4.   Results  For  Burst  Jamming  (JINTACCS  Versus 
Plain  Text) 

The  results  for  the  burst  jamming  mode  in  sub- 
experiment  1  (the  pilot  trials  at  NPS)  are  shown  in  Figure 
16.   The  parameters  selected  for  the  burst  jamming  are  shown 
in  the  figure.   As  can  be  seen  from  the  figure,  the  resulting 
curves  are  relatively  flat,  implying  that  within  the  range 
of  values  selected  for  the  burst  parameters,  understandability 
was  not  very  sensitive  to  the  percentage  of  jamming.   As  a 
consequence,  different  parameters  were  chosen  for  the  main 
experiment.   The  burst  results  for  sub -experiment  2  are 
shown  in  Figure  17.   As  can  be  seen  from  these  plots,  the 
results  are  again  fairly  level.   The  results  for  the  burst 
jamming  trials  in  sub-experiment  3  are  shown  in  Figure  18. 
A  plot  of  the  two  difference  curves  is  shown  in  Figure  19. 
As  can  be  seen  from  these  figures,  the  curves  have  a  steeper 
slope  than  the  pilot  trial  results  in  Figure  16,  looking 
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more  like  what  we  expected  to  see.   Note  also  that  the 
difference  curves  in  this  case  are  not  at  all  similar  to 
each  other  and  they  do  differ  from  the  continuous  jamming 
results  curve  shown  in  Figure  14.   As  the  size  of  the  burst 
increases  and  the  number  of  bits  between  bursts  decrease,  one 
would  expect  the  burst  results  to  approach  that  of  the 
continuous  results. 

5 .   Results  For  Subject  Attitudes 

The  subjective  questionnaires  given  after  sub- 
experiment  2  and  sub-experiment  3  at  Langley  AFB  were  scored 
and  an  average  computed  for  each  question.   These  averages 
along  with  the  questions  are  shown  in  Appendix  I.   A  shift 
in  attitudes  in  almost  all  questions  was  noted  and  the  shift 
was  from  favoring  plain  text  messages  to  being  either  neutral 
or  favoring  JINTACCS  messages.   It  is  apparent  that  the  time 
the  subjects  spent  between  sub-experiments  training  on  the 
JINTACCS  formats  tended  to  build  their  confidence  in  the 
JINTACCS  format. 
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III.   CONCLUSIONS 


This  thesis  sought  to  determine  if  there  was  any  signif- 
icant difference  in  understandability  between  the  JINTACCS 
message  formats  and  plain  text  messages  when  an  equal  amount 
of  jamming  is  applied  to  both  message  types.   It  also  sought 
to  estimate  the  understandability  curves  for  each  message 
type  for  a  range  of  levels  of  jamming  for  two  types  of 
jamming.   A  computer  program  was  written  to  simulate  the 
effect  of  continuous  and  burst  jamming,  and  experiments  were 
conducted  for  this  research. 

The  comparison  of  JINTACCS  to  plain  text  for  understand- 
ability revealed  no  statistically  significant  differences. 
Although  the  plain  text  scores  were  generally  higher  than 
the  JINTACCS  scores  in  the  first  comparison  test,  the 
differences  were  not  large  enough  to  be  significant  with  the 
size  of  the  samples  that  we  had.   The  scores  in  the  second 
comparison  test  after  the  subjects  had  received  more  training 
with  JINTACCS  showed  even  less  differences  in  the  understand- 
ability of  plain  text  messages  and  JINTACCS  messages.   The 
added  training  and  familiarity  with  JINTACCS  before  the 
second  comparison  test  seemed  to  explain  the  smaller 
differences. 

The  understandability  curves  that  resulted  for  both 
continuous  and  burst  jamming  conform  generally  to  what  one 
would  expect.   The  curves  were  similar  in  appearance  to  each 
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other.   The  experiments  revealed  that  at  3.0%  or  more 
continuous  jamming  at  the  bit  level,  about  half  the  under- 
standability  or  intelligibility  of  a  message  is  lost.   So 
it  appears  that  only  a  moderate  amount  of  jamming  can  cause 
a  devastating  effect  on  our  ability  to  communicate  critical 
information  in  written  messages. 

Apparently  little  has  been  published  on  the  understand- 
ability  or  intelligibility  of  written  communications.  Several 
sources  were  found  that  cited  verbal  intelligbility  tests, 
and  there  is  even  a  military  standard  of  intelligibility 
criteria  for  voice  communications  systems  [Ref.  27].   But 
no  standards  were  cited  for  written  or  message  communications 
This  seems  inconsistent  with  our  high  reliance  on  written 
message  communications  in  today's  military  environment. 

In  conclusion,  it  appears  that  messages  transmitted 
using  the  JINTACCS  message  formats  are  indeed  no  worse  nor 
better  than  plain  text  messages  with  respect  to  jamming 
survivability.   The  ability  of  military  personnel  to  rapidly 
adapt  to  the  JINTACCS  message  standards  was  amply  demonstra- 
ted during  the  first  comparison  test.   The  majority  of  the 
test  subjects  had  received  only  one  and  a  half  days  of 
training  on  the  JAMPS  computer  system.   This  speaks  well 
of  its  'user  friendly*  design.   Their  JINTACCS  scores 
improved  after  further  training  but  there  was  still  no 
statistical  difference  in  the  percent  of  understandability 
when  compared  to  plain  text  messages.   Since  the  experiment 
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was  conducted  using  the  JINTACCS  automated  message  processing 
system,  these  conclusions  should  not  be  generalized  to  the 
manual  method  of  using  the  JINTACCS  documentation.   The 
questionnaires  that  were  given  to  the  test  subjects  after 
the  first  and  second  experiments  showed  a  general  positive 
shift  in  attitudes  from  favoring  plain  text  messages  to  being 
either  neutral  or  favoring  the  JINTACCS  messages. 
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IV.   RECOMMENDATIONS  FOR  FURTHER  RESEARCH 

There  are  several  other  areas  that  lend  themselves  to 
follow-on  research.   One  would  he  to  conduct  the  same 
experiment  using  the  manual  mode  of  JINTACCS  documentation 
rather  than  JAMPS .   This  would  verify  whether  there  are  any 
differences  in  the  percent  of  understandability  between 
JINTACCS  and  plain  text  messages  using  the  manual  mode  of 
processing  JINTACCS  messages.   Another  area  that  should  be 
researched  is  the  possibility  of  'compressing*  JINTACCS 
messages  using  the  JAMPS  system.   Since  the  formats  are 
standardized,  the  formatting  information  would  appear  on 
the  operator's  terminal  screen  but  would  not  be  transmitted. 
Only  the  message  type  plus  some  method  of  separating  the 
data  need  be  transmitted  in  order  to  reconstruct  the  message 
at  the  distant  end.   This  would  reduce  the  length  of  trans- 
mission time  and  thus  should  allow  more  messages  to  be 
transmitted  in  the  same  time  period.   A  third  area  that 
could  be  researched  would  be  to  analyze  the  corrections  that 
the  subjects  made  or  identified  in  each  message  during  the 
understandability  tests.   The  data  were  collected  during  the 
experiments  reported  in  this  thesis,  but  they  were  not 
analyzed.   These  corrections  could  be  compared  to  the  total 
number  of  characters  that  were  garbled  to  form  another 
comparison  of  the  JINTACCS  results  to  the  plain  text  results 
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One  final  suggestion  would  be  to  research  possihle 
specific  equipment  jamming  threats  and  to  repeat  the 
experiment  using  those  jamming  parameters. 
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APPENDIX  B 
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